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1. The Field of the Invention. 
The present invention relates generally to methods of 

using oral movements, and more particularly, but not 
necessarily entirely, to methods of using movement of the 
15 tongue for providing speech therapy and speech assessment. 

2 . Description of Related Art. 

Speech is defined herein as the outcome of a biologically 
based propensity to imitate vocal gestures and sound patterns 
20 in communication development. The notion that humans use an 
inborn scheme, process, or representation to assimilate and 
organize phonological functions and to guide sound perception 
and production underpins the disclosure herein. This 
conceptualization, identified as the endogenous image mimicry 
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(EIM) hypothesis, is supported by prior findings from infant 
facial and vocal imitation, phonetic categorical perception, 
oral structure and function maturation, and optimum sound 
production observations. 

Studies of infant neonates have shown that babies imitate 
gestures such as mouth opening, tongue protrusion, and 
vowel-like utterances from early infancy without practice or 
trial and error. 

Speech developmental accounts seem to assume that hearing 
plays a virtually exclusive role in sound mimicry and speech 
learning. This viewpoint is supported by the observation that 
children with severe to profound hearing losses show major 
speech deficits from early infancy. The potential utility of 
vision in phonetic mimicry and sound learning has been 
clouded, however, by the inaccessibility of viewing most 
speech actions. Speech relevant acts such as early facial 
gesture and labial sound mimicry are in fact present in the 
responses of children with even profound hearing losses. Such 
findings suggest that vision could play an important role in 
later speech mimicry and articulatory learning if the learner 
could be given access to the normally hidden articulation 
gestures and actions. 
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In the late 1800s phoneticians discovered that they could 
visualize sound production patterns by coating the palate with 
powder, having the person speak, then sketching or 
photographing where the tongue made contact and removed the 
powder. The tongue-palate contact patterns were claimed to be 
distinctive regardless of individual subject differences. 
Saying a second sound, however, was noted to destroy the 
linguapalatal wipe pattern. This effect became quickly 
problematic when attempts were made to use this palatographic 
procedure in speech sound modification. For example, Barker 
(Journal of Speech Disorders, 2, p 165) reported that the 
Abbe Rousselot made "extensive use" of palatography to 
determine and correct articulator position. He was not 
successful, however, in his efforts to eliminate the English 
accent in French spoken by a single person during his 
five-year period of trials. Dynamic speech production thus 
remained physically inscrutable and the use of palatographic 
technology for speech training faded away. 

The 1950s and 60s brought a serious search for new ways 
to expose the dynamic nature of speech. Cineradiology 
provided a possible doorway but difficulties incident to the 
dangerous radiation inherent in x-ray exposure as well as 
problems with key frame selection, slow and arduous hand 
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tracing, noise that obscured acoustic details and soft tissue 
concealment behind bony structures severely restricted its 
speech remedial use. Computerized x-ray microbeam systems 
reduced the radiation, but this complex and expensive 
technology limited the diagnostic observations to a few points 
that could be tracked simultaneously. And radiation, though 
reduced, still blocked its use in speech remediation. In the 
1980s magnetic resonance imaging brought body-sectioning 
principles to speech studies but its cost and technical 
difficulties such as the need for the subjects to be in a 
supine position limited its remedial speech use. The 
limitation of the information to a few samples per second also 
discouraged its use in speech. 

Palatographic observations were reintroduced in the 1960s 
using electronic technology to overcome the single-sound 
observation limitations. Kusmin (Forth International Congress 
on Acoustics, Copenhagen, Report G35) in Russia used paired 
electrodes to detect linguapalatal contact. Although both of 
the electrodes needed to be contacted simultaneously to 
complete the circuit, several other investigators adopted this 
approach. Kydd and Belt (Journal of Speech and Hearing 
Disorders, 29:489-492) introduced a different palatographic 
approach. They used the tongue as the positive pole in a 

P.C. 

Page 5 of 61 



battery analog with twelve electrodes serving to detect 
linguapalatal contact. Both the Kusmin and Kydd-Belt systems 
were fraught with signal detection and sensor-to-sensor saliva 
bridging problems. 

In 1969 Fletcher, Berry, and Greer (see U.S. Patent No. 
4,112,596, granted September 12, 1978 to Fletcher et al.) 
introduced the use of an AC signal to inject an imperceptible 
current into the body. The current flowed from its source to 
and through the tongue to sensors on a 48-electrode 
"pseudopalate. " Their technology succeeded in virtually 
eliminating saliva bridging difficulties and enabled Fletcher 
and other associates to increase the number of pseudopalate 
sensors to 96. 

Since speech represents the output from a complex 
biological and phonological system, multiple sources of 
articulatory deviation may be expected. A long accepted 
general hypothesis among speech pathologists is that 
articulatory disorders are products of experiential and 
physical conditions that block a learner from achieving normal 
sound production proficiency. Several tests and measures, as 
described below, have been developed to help pinpoint possible 
sources of such deviations. 

a) Target to target tongue placement and motor control. 
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Observations since the early 1980 , s suggest that speakers 
plan and control motor movements to phonetically dictated 
target positions by using an internal spatial representation 
or cognitive topological map. To what degree a person is 
5 capable of discovering specific strategies during speech 
development that help them bypass or overcome structural 
and/or functional irregularities is still speculative. For 
example, certain deviations may block full use of a speaker's 
cognitive map. A more rapid speaking rate and reduced 



10 variability across age evidences increased motor skills with 



to help a speaker overcome physical deficits. On the other 
hand, Smith and Goffman (Journal of Speech, Language, and 



Hearing Research, 41:18-30) suggest that higher variability at 
15 younger ages may be beneficial. It could be a sign of greater 



neural network plasticity that would help children adapt to 
their rapidly changing oral structures during the 
developmental years . 

Disturbances at different locations within the motor 
20 control system may be hypothesized to signal unique 
disruptions in the movement actions and in the precision of 
goal posture achievement within the oral cavity. Due in part 
to past limitations in technology available to assess, 




maturation. Such increased motor skill would also be expected 
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differentiate, and classify oral motor disturbances, the 
validity of this hypothesis is conjectural at best, 
b) Maximum syllable repetition rate. 

Maximum syllable repetition rate measures are commonly 
5 used by speech pathologists in oral/peripheral examinations to 
assess oral motor skill in a speech-like activity. They may 
also be used to help predict reduced articulation improvement 
as a function of subnormal oral motor skills. The rationale 
behind these measures is that rapid speaking and oral reading 
^3 10 are usually carried out near a speaker's maximum sequencing 
isQ rate. Errors occur increasingly as the speaker is pressed to 

iy "speed up." This articulation fragility may be used to help 

^3 expose oral motor skill deficits. Such subnormal oral motor 

coordination would then be expected to influence speech 

P ; 15 mimicry skill. 

J?? 

O The traditional procedure for assessing maximum syllable 

repetition rate (MSRR) has been to count how many 
consonant-vowel syllable sets, such as "pataka," a speaker can 
repeat in five seconds. This procedure required the examiner 
20 to count the sounds and time lapse simultaneously. Fletcher 
(Journal of Speech and Hearing Research, 15, 763-770) 
improved this procedure by introducing the "time-by-count" 
method. In this method the examiner starts a stopwatch, 
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counts the set of syllables to a predetermined number, stops 
the watch, then reads and records the time lapse. Erroneous 
measures were reduced when this procedure was followed, but 
errors still remained a problem, particularly among novice 
5 examiners, 

c) Voice onset time. 

Interarticulator motor coordination is another important 
articulatory skill factor. Voice onset time (VOT) , defined as 
the time lapse between a stop consonant articulatory release 

am 

10 moment and the voicing onset of the following vowel, has been 
recognized as a sensitive index of interarticulator movement 

iy maturity. In adult spoken English, the laryngeal voicing 

III 

# action in voiced stop consonant production (e.g. /d/ in "do") 

!M f begins at virtually the same moment as the consonant release 

fr* 15 (± 20 ms) . In voiceless stop consonants (e.g. /t/ in "to") 

iF ■ 

13 the VOT is about 40 ms after the consonant release . These 

values vary from one language to another, but their temporal 
relationships are rather constant. 

In view of the interstructural coordination complexity 
20 and the hidden nature of the actions involved, it is not 
surprising that VOT time relationships are difficult to mimic. 
This is indicated by their slowness to reach mature values. 
During early speech development virtually all stop consonants 
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are voiced. That is, they have zero or short lag VOTs. Long 
lag VOT values that denote voiceless consonants emerge later, 
in the 2-to-6 year old age span. Neurological damage slows 
this developmental process. Thus, in the speech of those with 
5 cerebral palsy and dysarthria, VOT values continue to show 
almost exclusive use of short lag voiced stop consonants. The 
VOT scores of those with speech apraxia demonstrate yet a 
third pattern. In this condition the voiced versus voiceless 
consonant VOT scores overlap, reflecting oral and laryngeal 
# 10 motor discoordination. 

'0 Traditionally, the VOT has been measured acoustically. 

W Attempts to derive these measures from an acoustic signal 

W 

automatically have often been defeated, however, by the fact 
|p that the consonant release may produce only a brief, difficult 

fi^ 15 to detect, low intensity noise. This difficulty is compounded 

by other noises present during the stop closure period. 

d. Nonsense word repetition. 

Nonword repetition tests have been used with increasing 

frequency to measure phonological memory and vocabulary 
20 knowledge. Gathercole and associates (Applied Cognitive 

Psychology, 13:65-67) found a strong association between 

phonological working memory and vocabulary in adolescents. 

From this observation, they suggested that phonological 



Clayton, Howarth & Cannon, P.C. 

P.O. Box 1909 

Sandy, Utah 84091-1909 

Phone: (S01) 255-5335 

Fax: (801) 255-5338 



Page 10 of 61 



constraints continue to influence word learning beyond the 
childhood years. Linkage was also found between articulation 
deficits and nonsense word repetition errors. 

About half of the children with impaired speech 
5 articulation have associated language impairments. This 
proportion rises as the children pass beyond about six years 
in age and many of the childhood speech disturbances become 
normalized. Some have speculated that the linkage between 
speech/language impairment and malperf ormance on nonword 
^3 10 repetition tasks might reflect general processing capacity 
*i0 limitations in tasks that tap verbal working memory. In fact, 

iy the association between language deficits and subnormal 

*lQ nonsense word repetition performance appears to be so strong 

!M s that subperformance on the nonsense word tests has been 

|« 15 suggested to be a phenotype marker of inherited language 
13 impairment. 

e) Phonetic mimicry in the older child. 

Evidence that mimicry continues to play an important role 
in speech refinement has been shown in auditory stimulability 
20 studies. Stimulability, defined as a person's ability to 
imitate a sound not present in his/her phonetic inventory, has 
long been used as a sound learning readiness indicator. It 
has been noted that early investigators used stimulability as 
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a general predictor of the ability to correct articulation 
errors. More recently, investigators have tended to define it 
as a phoneme-specific predictor, based on the ability to 
imitate a sound that is absent from a child's phonetic 
5 inventory. 

Pre-treatment auditory stimulability has also been used 
to explain post-treatment articulation generalization. For 
example Powel et al (Journal of Speech and Hearing Research, 
34, 1318-1328) found that preschool children who misarticulate 

10 key sounds improved in production of those sounds during 
speech therapy regardless of the treatment targets. On the 
other hand, nonstimulable sounds were likely to require direct 
treatment. Accurate mimicry of a stimulus pattern may thus 
serve as an important self-correction predictor as well as a 

15 predictor of phonetic generalization and treatment 
responsiveness . 

f) Persistent misarticulation modification. 

Many children with childhood articulation impairments 
continue to experience speech difficulties into adolescence. 
20 Estimates from surveys conducted by public school speech 
pathologists indicate that possibly as many as 20% of the 
children with identified functional articulation disorders may 
experience persistent inability to overcome their disorders 
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through traditional, auditory-based speech remedial 
procedures. That is, they fail to overcome articulation 
disorders despite prolonged traditional speech remedial 
assistance. Such persistent deficits are particularly 
5 problematic to children after they enter the teenage years. 
Many studies have shown that speech performance can be 
enhanced even among children with profound hearing loss when 
the traditional auditory based remedial procedures are 
supplemented by articulatory or sound spectrographic acoustic 
<J3 10 feedback. This suggests that children with persistent 

it 

functional misarticulation could break through their 
iy articulatory learning barrier if appropriate visual 

^3 articulatory or acoustic modeling and shaping routines were 

|* available to fully arouse their ability to mimic modeled 

IM* 15 articulation patterns. 

r- 

Cf The relative benefits that might be obtained from 

linguapalatal contact versus, or combined with, acoustic 
formant based visual articulatory modeling and shaping 
routines in remedial articulation treatment have not been 
20 previously explored. This is true notwithstanding their 
interdependence. Their potentially beneficial cross feedback 
would seems to be particularly relevant to fully identifying 
articulation errors, improving articulation skill 
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generalization, and broadly helping to normalize speech 
skills • 

The prior art is thus characterized by several 
disadvantages that are addressed by the present invention. 
5 The present invention minimizes , and in some aspects 
eliminates, the above-mentioned failures, and other problems, 
by utilizing the methods and structural features described 
herein, 

BRIEF SUMMARY AND OBJECTS OF THE INVENTION 

10 It is therefore an object of the present invention to 

il3 provide method for utilizing lingual movements which allows 

speech therapy through visual modeling and mimicry. 

It is another object of the invention, in accordance with 
one aspect thereof, to provide a method for utilizing lingual 
15 movements for speech assessment. 

It is an additional object of the present invention, to 
provide a method for utilizing lingual movements to enhance 
lingual mobility. 

It is a further object of the present invention, in 
20 accordance with one aspect thereof, to provide a method for 
utilizing lingual movements to provide speech therapy for the 
hearing impaired. 



ii 
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It is another object of the present invention to provide 
a method for utilizing lingual movements to develop foreign 
language abilities . 

It is a further object of the present invention to 
5 provide a method for utilizing lingual movements to control 
external devices. 

The above objects and others not specifically recited are 
realized in a specific illustrative embodiment of a method for 
utilizing lingual movements for providing speech therapy by 
10 displaying model representations of a position of contact 
between a model tongue and mouth during speech; displaying a 
representation of a position of contact between a learner's 
tongue and mouth during speech; and instructing the learner to 
mimic the model representations of points of contact between 
fM* 15 the model tongue and mouth during speech. 



Additional objects and advantages of the invention will 
be set forth in the description which follows, and in part 
will be apparent from the description, or may be learned by 
the practice of the invention without undue experimentation. 
20 The objects and advantages of the invention may be realized 
and obtained by means of the instruments and combinations 
particularly pointed out in the appended claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The above and other objects, features and advantages of 
the invention will become apparent from a consideration of the 
subsequent detailed description presented in connection with 
5 the accompanying drawings in which: 

FIG, 1 is a perspective view of instrumentation used in 
the method in accordance with the principles of the present 
invention; 

FIG. 2 is a plan view of a flexible printed circuit used 
Cf 10 in the instrumentation of FIG. 1; 

FIG. 3 is a schematic view of the instrumentation of FIG. 
1, showing the sensor plate being installed in the mouth of a 
■ user; and 

|N f FIG. 4 is a schematic view of one of several possible 

!M* 15 embodiments of a circuit arrangement used to enable the 
13 palatometer of the present invention. 



ill 4 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

For the purposes of promoting an understanding of the 
principles in accordance with the invention, reference will 
now be made to the embodiments illustrated in the drawings and 
5 specific language will be used to describe the same. It will 
nevertheless be understood that no limitation of the scope of 
the invention is thereby intended. Any alterations and 
further modifications of the inventive features illustrated 
herein, and any additional applications of the principles of 
10 the invention as illustrated herein, which would normally 

•5 

i|3 occur to one skilled in the relevant art and having possession 

%j of this disclosure, are to be considered within the scope of 

fly 

the invention claimed. 
f k Referring now to FIG. 1, an exemplary embodiment of the 

^ 15 instrumentation used in the methods described herein is shown. 

,12 

*M The instrumentation is more fully described in U.S. 

Provisional Patent Application 60/233,770 incorporated herein 
by reference. A palatometer 12 includes a sensor plate 14, 
sometimes referred to as a pseudo palate, connected to signal 
20 processing and display equipment 16. The sensor plate 14 
preferably includes a flexible printed circuit 18, as best 
shown in FIG . 2 , mounted on a baseplate 20 . The flexible 
printed circuit 18 has contact sensing electrodes 22 
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distributed across its surface in a grid array. Preferably, 
the flexible printed circuit 18 is manufactured initially as 
a thin, flat plate with multiple lobes 24 intercoupled by a 
thin isthmus 26. This configuration allows the flexible 
5 printed circuit 18 to be adhered to a baseplate 20 which has 
been formed of soft plastic material to fit a user's palate 
and teeth configuration as shown in FIG. 3. Spaces 25 between 
the lobes 24 can be varied to allow the flexible printed 
circuit 18 to fit the curvature of the base plate 20 and at 
10 the same time retain the desired distances between sensors 22. 
4% The shape and flexibility of the flexible printed circuit 18 

|J allows the sensor plate 14 to fit the palates of users of 

W 

■Ci different sizes. The sensor plate 14 is constructed to be 

P ; thin, approximately 0.5 mm, to allow a user to comfortably 

I* 15 speak when the sensor plate 14 is installed in the user's 
O palate. The flexible printed circuit 18 also preferably has 

labial sensors 28 located on the sensor plate 14 so as to 
reside between the incisor teeth and lips of the user when 
installed. Several possible embodiments of a circuit 
20 arrangement may be used to enable the palatometer of the 
present invention, one of which is shown in FIG. 4. 

This preferred instrumentation, including palatometer 12 
having the electrode sensors 22 in a standard grid pattern, 
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enables detection, measurement , timing, and comparing of 
labial, linguadental, and linguapalatal contact. Contact with 
the electrode sensors 22 can preferably be displayed in a 
split screen 30 fashion. The display on one side of the 
5 screen represents contact with the electrode sensors 22 by 
the user. The other side can have representations generated 
by computer software or another user through another sensor 
plate 14. The palatometer 12 also preferably includes a 
microphone 32 to detect sounds made by the user. 

€3 

4?l 10 A method for utilizing lingual movements to foster 

€1 articulation change through modeling and mimicry will now be 

|J described. Preferably, a subject is fitted with a customized 

€r pseudopalate 14 that has an array of sensors 22 to detect lip 

& 

If* and tongue contact. As the palatometer 12 is used, contact 

fr* 15 with the sensors 22 is detected and routed to the processing 
*M and display equipment 16. Prior to contact, the palate 

sensors 22 are preferably shown on the monitor as small black 
dots 34 within a grid array. The dots 34 are located on the 
screen such that their placement is accurately portrayed with 
20 respect to the dental and palatal configurations. Teeth 36 
are represented as though the observer is looking upward from 
the tongue. The teeth 36 thus serve as natural orienting 
landmarks to help the observer focus on precisely how, when, 
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and where articulation actions transpire in the mouth as 
different sounds are modeled and articulated. Images of the 
dots 34 are preferably expanded in size and the colors changed 
to blue to indicate sensor contact as indicated at 38, Each 
5 of the expanded dots 38 represent contact with a corresponding 
sensor 22, thus the boundaries, extent, and areas of contact 
can be quantified. 

When palatometric data collection is activated, sensor 
contact may be collected and stored in computer memory, 
4g 10 preferably at a 200 Hz rate for example. Parallel acoustic 

, in 

np phonetic data is preferably captured and stored 

If* & 

|J simultaneously. In a feedback mode of the palatometer, real- 

CI time side-by-side contact pattern displays are preferably 

fr* generated from the model and learner responses at a 50 Hz 

P 15 rate. The model contact patterns are preferably drawn from 
p the prerecorded utterances with accompanying acoustic playback 

provided to help the speech-impaired learner mimic both the 
visual and auditory model patterns precisely. The stimulus 
sounds, words, phrases, and sentences to be spoken are 
20 preferably printed below the palatal images. 

In a redisplay or later analysis mode of the palatometer, 
articulation performance is preferably accompanied by a 
synchronized intensity by time waveform display. This permits 
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cursor controlled stop motion or dynamic image slow motion 
displays referenced to the time continuum when the sounds were 
produced. Automatic data analysis routines convert this 
information into quantitative contact place, configuration and 
timing descriptions. This allows numerical scores to be 
generated to represent how closely a learner's responses 
imitate a model as it is mimicked. The scores rise toward 
100% as the learner's responses approach a given modeled 
pattern. The numerical transformation thus fosters absolute 
mimicry through easily interpreted success reinforcement. 

Preferably, the learner is guided to mimic spoken sounds, 
words, and phrases from a model speaker, also referred to as 
an optimal speaker. The model speaker may be representative 
of a particular group, such as a particular age, gender, 
language type or any other category desired for the learner to 
mimic know to those skilled in the art. Preferably, visual 
mimicry accuracy is analyzed with respect to the match between 
the learner and the model. Visual mimicry accuracy may be 
analyzed with respect to the match between the modeled and 
mimicked linguapalatal contact place and timing during a given 
response. A numerical score may then be derived and displayed 
on the computer monitor that represents the closeness of 
contact pattern fit achieved in each learner response. The 

P.C. 
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visual feedback may be supplemented by learning curves that 
show mimicry accuracy for a given stimulus over time. Score 
improvements may be reinforced by written, computer generated 
congratulations and by dynamic displays on the computer 
5 monitor following successful responses for example. 

Auditory mimicry accuracy may be analyzed acoustically, 
and a numerical score derived and displayed on the computer 
monitor that represents the closeness of acoustic fit achieved 
in each of the learner's responses. The auditory feedback may 



10 be supplemented by sound spectrographic displays generated 
from the model stimuli and the mimicked responses. The 
numerical measure of improvement may be plotted in learning 
curves that show mimicry accuracy for a given stimulus over 
time. Score improvements may also be reinforced by computer 



15 generated audible congratulations and by dynamic displays on 



Situations in which target mimicry may be beneficial 
include for example: children unable to overcome speech 
disorders through traditional, auditory based therapy; those 
20 born with severe to profound hearing losses, including those 
who are deaf; persons with stroke-limited ability to control 
tongue movement and placement; persons with hearing loss 
limited high frequency sound perception which causes lisping, 




the computer monitor following successful responses. 
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"s" sound distortions and substitutions; persons with reduced 
ability to build up pressure in the mouth (e.g. from problems 
such as velopharyngeal incompetence related to palate clefts, 
submucous clefts, short palates, etc.); persons with 
5 maladaptations to physical abnormalities affecting the mouth 
and other parts of the vocal tract (e.g. prolonged loss of 
teeth in the developing child or adult, adjustments to 
malfitting dentures) ; guiding speakers to better ways to 
conserve a limited air supply (e.g. to develop and facilitate 

€f 10 esophageal speech after laryngectomy, to conserve air after it 

%$ 

hI3 has been reduced by chest or diaphragm injury or when a 

|j patient's physical condition limits the energy that can be 

devoted to speech activity) ; persons needing to learn new 
IM* speech patterns after cochlear implant surgery; people with 

!M* 15 gradually deteriorating hearing loss who need help to maintain 
C3 speech articulation skills; persons that can't discover from 

hearing alone how they are misarticulating sounds (e.g. 
foreign or regional dialects) . 

Thus, a method for providing speech therapy includes 
20 displaying a model representation of a position of contact 
between a model tongue and mouth during speech; displaying a 
representation of a position of contact between a learner's 
tongue and mouth during speech; and instructing the learner to 
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mimic the model representation. The representation of the 
position of contact between the learner' s tongue and mouth 
during speech is compared with the model, and the closeness of 
the match is mathematically quantified as a score, 
5 Lingual movements may also be used to assess the 

proficiency of speech. Since speech represents the output 
from a complex biological and phonological system, multiple 
sources of articulatory deviation may be expected. A long 
accepted general hypothesis among speech pathologists is that 
4% 10 articulatory disorders are products of experiential and 
nl3 physical conditions that block a learner from achieving normal 

|j sound production proficiency. The tests and measures, as 

^0 described below, have been developed to help pinpoint possible 

IM* sources of such deviations. 

P 15 One manner in which the proficiency of speech may be 

15 assessed includes assessment of lingual movements during vowel 

|fsls 

articulation. For example, measures may be obtained from 
repetitions of vowels (V) in isolation, and in the context 
with consonants (C) such as CVC, where C is a stop 
20 consonant (p, t, or k) or a fricative consonant (a consonant, 
such as s, produced by the forcing of breath through a 
constricted passage) such as in the sentence or predetermined 
syllable set "have a CVC away." As those skilled in the art 
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will recognize, various different predetermined syllable sets 
may be used within the scope of the present invention. 
Preferably, the participant repeats the predetermined syllable 
set as naturally as possible. Palatometric parameters may 
5 then be measured for each vowel in each context. Palatometric 
parameters as referred to herein are defined as measurements 
which describe the vocal process during speech as measured by 
an instrument such as a palatometer. For example, 
palatometric parameters include time from vowel onset to 
10 offset, jaw separation at vowel midpoint, distance between the 
most anterior palatometric sensor contacted and the central 
W incisor edge 40, distance laterally between the innermost 

; C sensor contacted and the dental margin 42, palatal surface 

p area contacted, channel width at its narrowest point between 

IN- 

9^ 15 the sensors, distance from the front sensor contacted to the 
p central incisor tip sensors 44, mid-sagittal distance 

(measured by the two rows of sensors 4 6 that are immediately 
adjacent the mid line) between front and back sensor contacts 
during stop consonants, width of the stricture opening during 
20 speech of fricatives, affricatives (composite speech sounds 
consisting of a stop and a fricative articulated at the same 
point, as "ch" in "chair" and "j" in "joy") and laterals 
(sounds produced by breath passing along one or both sides of 
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the tongue, such as in "1"), or any other measurement known to 
those skilled in the art which is suitable for comparing 
speech of different speakers. The palatometric parameters 
measured may be compared to a standard to assess the speech of 
5 an individual. 

Similarly, consonant articulation may be assessed by 
repeating different kinds of consonants such as nasal 
(articulated by lowering the soft palate so that air resonates 
in the nasal cavities and passes out the nose, as in the 

10 pronunciation of the nasal consonants m, n, and ng) , stop, 
fricative, affricates and approximant consonants. Each sound 
may be tested in isolation and in a point vowel context such 
as in the predetermined syllable set "have a VCV away, " spoken 
as naturally as possible. Applicable palatometric parameters, 

15 as discussed above, may be measured during repetition of the 
consonants for comparing with a standard to assess the speech 
of the individual. 

Another manner in which lingual movements may be used to 
assess speech includes the palatometric target to target 

20 movement tracking paradigm, used to help define lingual motor 
skill. Preferably, tongue tip placement at a preestablished 
target point in the 3-dimensional Euclidean space around the 
dental-gingival surface is established. Tongue tip movement 
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velocity, time lapse and placement accuracy may then be 
measured as the testee moves the tongue in a random order from 
this point to other points along the dental-gingival border. 
The resultant data may be logged in a computer file for later 
5 analysis and also summarized in computer screen displays. The 
purpose of the numerical feedback in the displays is to 
encourage the testee' s best effort, to reinforce performance 
improvements, and to examine possible differential changes in 
lingual manipulation proficiency as a function of the target- 
.mJ3 10 to-target test experience. 

i 

*Q The location of the targets and the initiation of the 

|j start signal may be generated by computer software or a 

m S 

4& practitioner for example. The results of the target to target 

lM f analysis may be compared to a standard, earlier results from 

!M* 15 the testee, or another person for example. 

13 The ability to identify, gauge, and classify lingual 

control numerically may enhance the ability to identify motor- 
control irregularities and abnormalities. This information 
may also be used to help isolate specific lingual movement 
20 skill deviations that might influence articulation mimicry. 
Additionally, the databased information may help explain 
differences found in articulation skill change through 
acoustic and/or linguapalatal contact visual mimicry. 
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Another valuable tool for assessing the proficiency of 
speech is the maximum syllable repetition rate. Disturbances 
affecting syllable repetition rate include for example: slow 
rate from oral motor control immaturity (younger children have 
slower rate) ; slow rate from paralysis or paresis (weakness) 
of the speech articulators; variable rate from 
discoordination; slowing or drifting from maximum rate from 
attention deficit or concentration loss; and breaks in rhythm 
from reduced speech motor control. The detection of oral 
movements may be used to more efficiently establish a 
participant's repetition skill. Preferably, the number of 
predetermined syllable sets, for example pa, ta, ka, pata, 
taka, or pataka, repeated during a standard response period, 
preferably five second, is established. As those skilled in 
the art will appreciate, other predetermined syllable sets and 
response periods may be used within the scope of the present 
invention. The time lapse measures may begin at the moment 
the initial consonant contact is released at the lips, tip of 
tongue, and/or back of the tongue. The syllable repetition 
rate may then be calculated and automatically printed out by 
syllable across the complete syllable set and a general score 
derived. A number of secondary measures such as response rate 
variability, rhythm disturbances, rate slowing, and drifting 
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toward imprecise sound patterns may also be generated. These 
maximum syllable repetition rate measures, along with the 
target-to-target motor control measures, provide a rich set of 
observations to evaluate possible motor skill, coordination 
5 deviation, and motor impairment among the normal speaking and 
articulatory impaired individuals. 

Another tool which may be used to assess speech is the 
voice onset time (VOT) assessment, or measurement of the time 
lapse between a stop consonant articulatory release moment and 
:s|3 10 the voicing onset of the following vowel. An example of the 

'•Hp? 

4* stop consonant articulatory release moment is the moment the 

y tongue is released from the palate to make a "t" sound. While 

4% VOT has been measured acoustically, the consonant release may 

!M* produce only a brief, difficult to detect, low intensity 

IM* 15 noise. Oral movements may be detected to eliminate the 
O uncertainties of acoustic VOT measures. Among the benefits 

from the present invention is that VOT values may now be 
easily, accurately, and automatically obtained. 

To determine the VOT values for a testee, the testee is 
20 fitted with a sensor plate 14 of the palatometer 12 and 
instructed to speak an utterance. Preferably the testee is 
instructed to read five randomized sets of 12 vowel-consonant- 
vowel (VCV) words embedded in the sentence "Have a VCV away." 
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The representation C = /p/, /b/, /t/,/d/, /k/, or /g/, V = 
/i/ or /u/) is intended to indicate sets of consonants and 
vowels from which vowel-consonant-vowel speech clusters can be 
formed for such exercises, wherein "C" means "consonant" and 
5 "V" means "vowel." For example, the speech clusters "ibi, " 
"udu" and "iki" could be selected, as well as several others. 

As those skilled in the art will recognize, other sets of 
vowels, consonants, words, and sentences may be used within 
the scope of the present invention. The acoustics are 
0 10 detected through the microphone 32 and the oral movements are 
^13 detected by the palatometer. The mean time lapse from stop 

hi consonant constriction release moment, as detected by the oral 

4% movements, to the acoustically detected guasiperiodic vocal 

|M ? fold vibration onset denoting the vowel steady state may then 

!M* 15 be established for each utterance set. These values may be 
C analyzed to determine and compare differences in the VOT 

scores with other VOT scores such as a standard, a particular 
age or gender, or other desired representation. 

Another advantage of the present invention is that 
20 lingual mobility may be enhanced. For example, in the event 
an individual has a condition which affects the speech, such 
as the removal of a portion of the tongue, the individual may 
view palatometric data from others who overcame a similar 



Clayton, Howarth & Cannon, P.C. 

P.O. Box 1909 

Sandy, Utah 84091-1909 

Phone: (SOI) 255-5335 

Fax: (801) 255-5338 



Page 30 of 61 



condition to see how lingual movements may be altered to 
compensate for the condition. In this manner, compensatory 
tongue postures may be developed. Similarly, a practitioner 
may develop tongue exercises to assist in the enhancement of 
5 lingual mobility. Examples of circumstances where tongue 
exercises may be beneficial include: weakness following 
stroke; improving tongue movement precision related to 
cerebral palsy and other neurological disorders; helping to 
recover from chewing and swallowing impairment (e.g. from 

10 lingual tissue excision incident to surgery from vocal tract 
cancer, full mouth dental extraction, car or other accidental 
damage) ; and person such as trumpet player who wants to 
increase lingual dexterity. 

The individual is instructed to perform a lingual 

15 movement which is designed to enhance lingual mobility or 
speech. Representations of a position of contact between the 
tongue and mouth are displayed so that the individual can see 
how to position the tongue. The individual can then repeat 
the lingual movements to improve the individual's speech. 

20 Oral movements can also be used to exert control over 

external devices having electronic controls. Electronic 
controls as referred to herein include any system, known to 
those skilled in the art, for manipulating a device which can 
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be activated electronically. For example, wheel chairs may be 
operated by electronic controls. The electronic controls may 
be connected to a sensor plate 14 so that oral movements can 
operate the wheelchair. This arrangement is beneficial to 
5 those who would otherwise be unable to operate the wheelchair. 
A contact point may be established on a particular area of the 
sensor plate 14 to operate a particular function. For 
example, contact points may be established on the front, back, 
left, and right sides of the sensor plate 14 to operate 
.;•£! 10 forward, reverse, left turn and right turn functions 
^1 respectively. As those skilled in the art will recognize, one 

iy or a plurality of contact points may be established in various 

m i 

locations on the sensor plate 14 to operate numerous different 
jh* functions of external devices. The user may simply touch a 

P 15 contact point with the tongue wherein the flow of electricity 

A* 

|p through the tongue and the contact point (sensors 22) on the 

sensor plate 14 activates the wheelchair. Electronic games, 
devices producing depictions of cartoon mouth movements, and 
other devices known to those skilled in the art may also be 
20 controlled by lingual movements in a similar fashion. 

In view of the foregoing, it will be appreciated that the 
present invention provides a method for utilizing lingual 
movements which allows speech therapy through visual modeling 
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and mimicry. The present invention also provides a method for 
utilizing lingual movements for speech assessment and 
enhancement of lingual mobility. The methods provided herein 
are advantageous for those with speech problems, the hearing 
5 impaired, as well as those learning foreign languages. The 
present invention also provides for utilizing lingual 
movements to control external devices. 

It is to be understood that the above-described 
arrangements are only illustrative of the application of the 

10 principles of the present invention. Numerous modifications 
and alternative arrangements may be devised by those skilled 
in the art without departing from the spirit and scope of the 
present invention and the appended claims are intended to 
cover such modifications and arrangements. Thus, while the 

15 present invention has been shown in the drawings and fully 
described above with particularity and detail in connection 
with what is presently deemed to be the most practical and 
preferred embodiment (s) of the invention, it will be apparent 
to those of ordinary skill in the art that numerous 

20 modifications, including, but not limited to, variations in 
size, materials, shape, form, function and manner of 
operation, assembly and use may be made without departing from 
the principles and concepts set forth herein. 
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